Skip to content

Add 9 providers, GPT-5 family, and updated Claude pricing#8

Merged
DanialBeg merged 1 commit intomainfrom
feat/more-providers
Mar 17, 2026
Merged

Add 9 providers, GPT-5 family, and updated Claude pricing#8
DanialBeg merged 1 commit intomainfrom
feat/more-providers

Conversation

@DanialBeg
Copy link
Contributor

Summary

  • Add 9 new LLM providers (7→16 total): Azure OpenAI, Together AI, Fireworks AI, Perplexity, OpenRouter, xAI (Grok), Cerebras, SambaNova
  • Add full GPT-5 pricing family (19 models): gpt-5 through gpt-5.4-pro
  • Update Anthropic pricing for Claude 4.5/4.6 generation (Opus dropped from $15/$75 to $5/$25)
  • Add o3-pro and o1-pro reasoning model pricing
  • Add Azure api-key header support in API key extraction

New providers

Provider Type Routing Upstream
Azure OpenAI Custom parser /azure/openai/deployments/... User-provided
Together AI OpenAI-compat /together/v1/... api.together.xyz
Fireworks AI OpenAI-compat /fireworks/v1/... api.fireworks.ai
Perplexity OpenAI-compat /perplexity/v1/... api.perplexity.ai
OpenRouter OpenAI-compat /openrouter/v1/... openrouter.ai/api
xAI (Grok) OpenAI-compat /xai/v1/... api.x.ai
Cerebras OpenAI-compat /cerebras/v1/... api.cerebras.ai
SambaNova OpenAI-compat /sambanova/v1/... api.sambanova.ai

Test plan

  • All existing tests pass
  • New Azure provider tests (match, rewrite, parse request/response)
  • New OpenAI-compat tests (names, defaults, match, rewrite for all 7 providers)
  • API key extraction test for Azure api-key header
  • Newest model pricing tests (GPT-5, Claude 4.6, o3-pro disambiguation)
  • Pre-commit hooks pass (fmt, vet, lint, test)

New providers (7→16 total):
- Azure OpenAI (custom parser for /openai/deployments/ URL scheme)
- Together AI, Fireworks AI, Perplexity, OpenRouter, xAI, Cerebras,
  SambaNova (all OpenAI-compatible with path-prefix routing)

Pricing updates:
- Add full GPT-5 family: gpt-5, 5-mini, 5-nano, 5-pro, 5-codex,
  5-chat, 5.1–5.4 variants (19 models)
- Add o3-pro and o1-pro ($150/$600 per MTok)
- Fix Anthropic 4.5/4.6 pricing: Opus dropped from $15/$75 to $5/$25
- Add claude-opus-4.1, claude-3.7-sonnet, dot-notation model IDs
- Add xAI Grok-3, Perplexity Sonar, Together/Fireworks/Cerebras/
  SambaNova hosted model pricing

Also: Azure api-key header support in ExtractAPIKey
@DanialBeg DanialBeg requested a review from ZubairQazi March 17, 2026 01:19
@DanialBeg DanialBeg self-assigned this Mar 17, 2026
@DanialBeg DanialBeg merged commit 5c03d58 into main Mar 17, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant